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^ Abstract 

r~| We study a warped extra-dimension scenario where the Standard Model fields lie in the bulk, 

II with the addition of a fourth family of fermions. We concentrate on the flavor structure of the Higgs 

Q couplings with fermions in the flavor anarchy ansatz. Even without a fourth family, these couplings 

I— I will be generically misaligned with respect to the SM fermion mass matrices. The presence of the 

^— I fourth family typically enhances the misalignment effects and we show that one should expect them 

> 
■^ to be highly non-symmetrical in the (34) inter-generational mixing. The radiative corrections 

O 

^^ from the new fermions and their flavor violating couplings to the Higgs affect negligibly known 

experimental precision measurements such as the oblique parameters and Z — )■ 66 or Z — t- ;U+/x^. 

^^ On the other hand, AF = 1,2 processes, mediated by tree-level Higgs exchange, as well as radiative 

T-H 

T-H corrections to 6 — )■ 57 and ^ — )■ 67 put some generic pressure on the allowed size of the flavor 

^ violating couplings. But more importantly, these couplings will alter the Higgs decay patterns as 

rN well as those of the new fermions, and produce very interesting new signals associated to Higgs 

phenomenology in high energy colliders. These might become very important indirect signals for 
these type of models as they would be present even when the KK mass scale is high and no heavy 
KK particle is discovered. 
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I. INTRODUCTION 

The Standard Model (SM) of particle physics has been remarkably successful in explaining 
a wide range of low-energy phenomena and has passed numerous experimental tests over 
the past few decades. The only ingredient of this model that has yet to be discovered is 
the Higgs boson. If the Higgs is discovered at the LHC, the problem of its mass, which 
should receive quadratic corrections sensitive to scales well above the electroweak scale 
(the hierarchy problem) still remains. Warped extra dimensional models were introduced 
by Randall and Sundrum (RS) [1] as an attempt to resolve this problem, by using the 
extra-dimensional space-time warp factor to lower the natural scale of particle masses. In 
the original model, all SM fields were localized on the TeV brane, one could in principle 
generate higher dimensional flavor violating operators, suppressed by only TeV operators-a 
serious problem for phenomenology. To address this issue one could invoke for example flavor 
symmetries |2j but the most popular venue has been to allow fermions to propagate in the 
bulk, which not only reduced the flavor problem, but provided a compelling theory of flavor, 
in which hierarchies among fermion masses and mixings arise naturally [3l H]. This model 
sheds light on the flavor puzzle as well: the 5D Yukawa couplings are all 0{1) and with no 
definite flavor structure, and the fermion masses and mixing angles depend on the amount of 
mixing of the elementary fermions with the strongly coupled conformal field theory, assumed 
to be small for the first two generations [1]. This implies that flavor violation in the SM is 
also suppressed by the same mixing factors - the phenomenon that goes under the name of 
the RS-GIM mechanism [5] . However, in this case constraints from the AS = 2 and AB = 1 
processes still require the scale of new physics (the KK scale) to be around ~ 5 TeV [HI [7] , 
raising difficulties with observation of this minimal scenario directly at the LHC. 

On the flavor side, recently, some possible deviations from the SM in B meson [HI |9] and 
t quark physics [lU] have been reported, indicating perhaps difficulties with the standard 
Cabibbo-Kobayashi-Maskawa (CKM) paradigm for quark mixing [11]. The effects in B 
physics can be explained by various Beyond the Standard Model (BSM) scenarios, though 
the simplest explanation seems to come from a simple extension of the Standard Model 
to four generations, that is, by adding two new heavy quarks, a heavy charge +2/3 quark 
(t') and charge —1/3 quark (6'). In more extensive versions of the model, the effects of 
introducing extra leptons (r' and u'^), needed for anomaly cancellation, are also studied. 

The addition of a fourth sequential generation of fermion doublets is a natural extension 
of the SM (SM4). The model restricts fourth-generation quark masses to be not too large 
to preserve perturbativity [12]. Recently, SM4 have increased in popularity as it was shown 
that the introduction of a fourth generation does not conflict with electroweak precision 
observables |T3] , as long as their mass differences are small [H] . Fourth generation fermions 



are required to have masses greater than half the mass of the Z^ boson to evade LEP hmits 
on the invisible Z^ boson width. There are many advantages of introducing an extra family 
of fermions: 

• These new fermions may trigger dynamical electroweak symmetry breaking [12j with- 
out a Higgs boson, and thus address the hierarchy problem. 

• A fourth generation softens the current low Higgs mass bounds from electroweak pre- 
cision observables by allowing considerably higher values for the Higgs mass jT5] . 

• Gauge couplings can in principle be unified without invoking SUSY [TB] . 

• A new family might cure certain problems in flavor physics, such as the CP-violation 
in 5s-mixing [T7] . 

• A fourth generation might solve problems related to baryogenesis, as an additional 
quark doublet could lead to a sizable increase of the measure of CP-violation 



Such an extension of the SM would increase the strength of the phase transition [19] . 

It appears that an even number of fermion generations is more natural from the string 
theory point of view 



New heavy fermions lead to new interesting effects due to their large Yukawa couplings 
Recent searches by the CDF Collaboration for direct production of the fourth generation 
quarks, called t' and b', set the limits nit' > 335 GeV [22] and m^/ > 385 GeV [23], assuming 
Br(f -^ Wq{q = d,s,b)) = 100% and Br{b' -^ Wt) = 100% respectively. For the leptons 
mr' > 100.8 GeV, m^/ > 90.3 GeV (Dirac type), m,,/ > 80.5 GeV (Majorana type) [21]. 
The limits on the low energy phenomenology due to fourth generation fermions has been 
studied extensively [251 EE] . 

While there have been many extensive studies of the SM4, there are few analyzes of BSM 
scenarios with four generations (see however [2Z])- The reason is that the fourth generation 
typically imposes severe restrictions on the models. In particular, there are difficulties in 
incorporating a chiral fourth family scenario into any Higgs doublet model, such as the 
MSSM [2H]- It was initially shown that due to the large masses for the fourth generation 

V 

quarks and large Yukawa couplings, there are no values of tan /3 = — > 1 for which the 
couplings are perturbative to the Grand Unification Scale. (However, this condition does 
not apply to vector-like quarks [29].) Recently the MSSM with four generations has received 
some more attention [3D], as it was shown that for tan/3 c^ 1 the model exhibits a strong 
first order phase transition [3T] . 



But the four generation scenario can easily be incorporated in models with warped extra 
dimensions, as in [32], where it can be argued that the fourth generation arises naturally. 
In these models the Higgs particle can be thought of as a generic composite state, and even 
being a condensate of some of the fourth generation heavy quarks |32l [33], thus providing a 
solution to the (little) hierarchy problem. 

An additional benefit of the extension of a fourth generation in warped models, could be 
the inclusion of the fourth generation neutrino, which may become a novel dark matter can- 
didate [31], typically missing in minimal models (see however [35] for different approaches). 

As mentioned earlier, KK particles could be just barely beyond the reach of the LHC Nev- 
ertheless there are implications of the warped scenarios that could leave an imprint on lower 
energy physics. For instance, recently it was pointed out that warped extra-dimensional 
models introduce new flavor-violating operators in the Higgs sector. In a composite Higgs 
sector with strong dynamics, flavor changing neutral currents (FCNC) can arise at tree level, 
generated by a misalignment between the Higgs Yukawa matrices and the fermion mass ma- 
trices [36ti38] . The full set of operators responsible for the misalignment has been thoroughly 
analyzed, showing that the effect is generically large and phenomenologically important [3H] 
and even could alter considerably the couplings of Higgs to gluons [391 SO] , affecting thus 
the main production mechanism of the Higgs at hadron colliders. 

These flavor violating effects will be even more pronounced if the matter sector is extended 
by extra fermionic generations. And for the Higgs bosons, it is well known that the effects 
of a fourth generation are quite spectacular in modifying the Higgs boson cross-section at 
hadron colliders, which can be tested easily with Tevatron and early LHC data within this 
or the next year. The Tevatron has published limits on the Higgs boson cross-section in the 
fourth generation model, excluding a wide range of Higgs boson masses [H], and recently 
the CMS collaboration carried out a similar study |42j . 

As Higgs production can be modified within warped scenarios due to flavor violating 
effects in the Higgs sector |3Dj, it may be possible to distinguish signals coming from a 
fourth generation model within the SM (SM4) with those coming from a fourth generation 
model associated with a warped extra-dimension (or a composite scenario), and, given the 
searches for the Higgs boson underway at the LHC, such an analysis is timely. The inclusion 
of the fourth generation will also affect low-energy precision observables, as well as limits 
on rare decays. In the lines of [38J, we propose to explore here the effect of FCNC Higgs 
couplings with a fourth generation in a simple warped extra dimensional model. 

Our work is organized as follows. In the next section. Sec. [Tl| we summarize the features 
of the warped extra-dimensional models with fermions propagating in the bulk. We analyze 
the flavor structure with fourth generational mixing in Sec. |III[ giving both analytical 
expressions and numerical values. We proceed to explore the phenomenology of the model 



in Sec. IV Restrictions due to flavor-changing low energy observables, both at tree and 
one-loop level, are included here. In subsections, we investigate FCNC decays of the Higgs 
boson, as well as collider signals for the fourth generation decaying into lighter fermions and 
Higgs bosons. We summarize our findings and conclude in Sec. |V| In the Appendices we 
include some details of our analytical evaluation. 

II. THE MODEL 

For simplicity, we consider the simplest 5D warped extension of the SM, in which we keep 
the SM local gauge groups and just extend the space-time by one warped extra dimension. 
There are bounds on the KK scale coming from precision electroweak observables |13] which 
can be addressed by extending the gauge group in order to obtain additional protection. 
Nevertheless the effects we are interested in lie in a different sector of the scenario, namely 
the Higgs sector, and its couplings with fermions. Our results can easily be extended to more 
involved scenarios, but we feel it is best to show explicitly the effects in the simplest scenario. 
Moreover precision electroweak constraints can become milder with a heavier Higgs [B] and 
perhaps even if the KK scale is barely beyond LHC reach, one can observe its indirect effects 
in the Higgs sector. 

The spacetime we consider takes the usual Randall- Sundrum form [T]: 

ds^ = —U^^dx^'dx" - dz^\ , (1) 

with the UV (IR) branes localized a,t z = R {z = R'). We first focus on a single family 
of down-type quarks Q, D. They contain the 4D SM SU{2)i doublet and singlet fermions 
respectively with a 5D action 

Siermion = j d^xdz^^- {QT^VaQ - VaQT^Q) + |QQ +{Q^D), (2) 

where Cq and q are the 5D fermion mass coefficients. We also consider a brane localized 
Higgs, and so the Yukawa couplings in the Lagrangian are included in the action 

^brane = I d^xdz 5{z - R!) (^ H {Y^'' RQlV R + Y^^RQrVl + h.c.) . (3) 

To obtain a chiral spectrum, we choose the following boundary conditions for Q, D 

Qd++), Qr{—), Dl{—), Dr{++). (4) 

Then, only Ql and Dr will have zero modes, with wavef unctions: 

qUz) = f{c,)?^z'~^^, (5) 

4(^) = /(-c.)^^-^^^^^+'=^ (6) 
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FIG. 1: Correction to fermion mass and to physical Yukawa coupling (right diagram) after inte- 
grating out heavy vector-like fermions (the fermion KK modes here). In the right diagram, the 
correction to the mass happens when all the Higgs bosons acquire their VEV. The correction to 
the Yukawa coupling occurs when one of the Higgs remains physical; since there are three ways of 
doing this, mass correction and Yukawa correction are not the same, creating a shift between both 
terms (or a misalignment in flavor space). 



where we have defined /(c) = \ jz^r^ and the hierarchically small parameter e = R/R' ~ 
10~^^, which is generally referred to as the warp factor. Thus, if we choose Cg(— q) > 1/2, 
then the zero modes wavefunctions are localized towards the UV brane; if Cg(— q) < 1/2, 
they are localized towards the IR brane. The wavefunctions of the fermion KK modes are 
all localized near the IR brane. Note that the wavefunctions of the KK modes Qr and 
Dl vanish at the IR brane due to their boundary conditions. The Yukawa couplings of 
the Higgs with fermions (zero modes or heavy KK modes) are set by the overlap integrals 
of the corresponding wavefunctions. For a bulk Higgs localized near the IR brane, the 
zero-zero-Higgs, zero- KK- Higgs, KK-KK-Higgs Yukawa couplings are given approximately 
by 



>d,00 ~ YJ{Cq)f{-Cd), 

Yd,on ~ y*f{cq) or Y^f{-Cd) 



Yr. 
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Y 



(7) 
(8) 
(9) 



where F* = Yd/yR is the 0{1) dimensionless 5D Yukawa coupling, and we ignored C(l) 
factors in the equations above. The SM fermions are mostly zero mode fermions with 
some small amount of mixing with KK mode fermions. Therefore, we can use the mass 
insertion approximation to calculate the corrections to the masses and Yukawa couplings of 
SM fermions. This is shown in Fig. [I], where ql, d^ are zero modes of SU{2)l doublet and 
singlet fermions respectively and Ql, Qr, Dl, Dr are KK mode fermions. One finds 



m 



SM 



f{Cg)YJ{-Cd) V4 - /(c, 



y2 2 



f{-Cd)Y^ V4, 



(10) 



where f 4 is the Higgs vacuum expectation values (VEV) and we assume that all KK fermion 
masses are of the same order [Mkk)- The 4D effective Yukawa couplings of SM fermions can 



be calculated using the same diagram, but the correction will be different. This is because 
in the second diagram of Fig. [l| we have to set two external Higgs bosons H to their VEV 
f4 while the other one becomes the physical Higgs h, and there are three different ways to 
do this. Thus we obtain the 4D Yukawa couplings 

y'sM ^ f{c,)YJ{~c,) - 3/(c,)|^/(-q)1;. (11) 

We see that the SM fermion masses and the 4D Yukawa couplings are not universally pro- 
portional; indeed there is a shift with respect to the SM prediction of m^^y^ = y'sM'^'i- 

This shift, or misalignment, defined as A"' = m'^ — V^v^ can be carefully calculated 
perturbatively including C(l) factors. It is found to be 



Note the presence of the independent couplings ¥2^ which are not necessary for generating 
fermion masses. It is technically possible to set their values as small as necessary and 
suppress the misalignment. Nevertheless this seems to go against the main philosophy of 
our approach which assumes that the value of all dimensionless 5D parameters is of order 
one. Moreover in the case where the Higgs is a bulk scalar field we have Yi = Y2, which is 
the simplifying assumption we will make for our numerical computations. 

There is another contribution to the misalignment which can be also calculated and is 
given by [38] 



Ai = m,\m,\'R" [K{c,) + K{-Cd)] , (13) 



with 



2c 



2c-l _ g2 gl-2c _ 2 



(14) 



e2c-i-l (e2c-i-l)(3-2c) (1 + 2c)(e2c"i - 1) 
One can see that Af and A2 can be of the same parametric order only for IR localized 
fermions (heavy quarks), but will be quite suppressed for light quarks. 

III. FLAVOR STRUCTURE WITH FOUR FAMILIES 

We now proceed to add to the scenario the remaining families of quarks and leptons, 
including a new fourth generation. This will of course create a richer structure of flavor, not 
only in the Higgs sector, but in the electroweak sector, where the flavor changing charged 
current mediated by W bosons will now contain new vertices with the addition of t' and b'. 

The fermion wavefunctions evaluated at the TeV brane (/(c)) are now promoted to di- 
agonal matrices Fq = diag[/(cqj] and Fd = diag[/(crf-)]. Small differences in the c's will 
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FIG. 2: Typical geographic location of quarks in RS-4GEN (RS with a fourth family) such that 
large quark mass hierarchies and small mixing angles are generic. The Higgs boson and the heavier 
fermions (top and fourth generation quarks and charged leptons) are localized near the TeV brane, 
whereas light fermions are localized towards the Planck brane. 

produce large hierarchies in the values of /(c) (i.e. geographical fermion localization in the 
extra dimension), and so the matrices F^^^ are highly hierarchical, leading to mass hierarchies 
and small mixing angles. 



A. The quark mixing matrix Vckw^ 

The mass matrices are 

niu = 
nid = 



Fq ^d Fd, 



(15) 
(16) 



where Fq, Fu and F^ are 4x4 diagonal matrices whose entries are given by the values at 
the IR brane of the corresponding zero-mode wave functions: 
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The matrices Y^ and Y^ are the 5-dimensional Yukawa couplings, i.e. general 4x4 complex 
matrices. Because most of the entries in the diagonal matrices Fq are naturally hierarchical 
(for UV-localized fermions), the physical fermion mass matrices m„ and m^ will inherit their 
hierarchical structure independently of the nature of the true 5D Yukawa couplings Yu and 
Yd, which can therefore contain all of its entries with similar size (of order 1) and have no 
definite flavor structure. This is the main idea behind scenarios of so-called flavor anarchy, 
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which we consider also here, but apphed to a four-family scenario. The introduction of the 
fourth family is simply realized by assuming that the new fermions are localized near the 
TeV brane, like the top quark, and therefore will be naturally heavy. Mixing angles should 
typically be small except among the heavy fermions where large mixings could be possible. 
To diagonalize the mass matrices we use 



Uq. m„ Wl 
Uq, ma W^] 



m 



diag 



m 



diag 



(18) 
(19) 



One can in fact obtain a relatively simple formulation of the rotation matrices Uq^, Uq^, W^ 
and Wd by expanding their entries in powers of ratios fi/fj, where i < j and with i = 1,2 
and j = 1, 2, 3, 4. To proceed, we first define our notation. If A is an n x n matrix, then [A] . . 
represents its {ij} first order minor, i.e. the determinant of the {n — 1) x [n — 1) submatrix 
obtained by removing row i and column j from A. We also use the notation [A]^. ^ to 
represent the {ij, a/3} second order minor of A, i.e. the determinant of the (n — 2) x (n — 2) 
submatrix obtained by removing rows i and a, and columns j and /3 from the matrix A. 
Keeping only the leading terms, we obtain (see [H] for the three family case): 
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(20) 
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[^JIl /Q3 

_ ['^^41 /Qi 

where, in particular, we have 
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(22) 



IjQd _ ^ JQl l.^'^J21,32 I * JQl [^d\21,i2 fr,o\ 

where we used properties of the minors. These are needed to compute the Vckm elements 
Vcb and Vub- Due to the mass hierarchy mh ^ mh>, we also have the simple expansions: 

CQ, = V, /gJ^JnllM' and s*q^ = v, IgJ^J^'; /m,> e^-g(^4l). (24) 

Since 

Vckm = U^Uq,, (25) 

we can find expressions for Vus, Vcb and Vub'- 

V^^ = ^ (\^ - i^) , (26) 

and 



fQ.WdL [yuij' 



and 



T^ _ JQ2 I [^d\ii^32 _ [-'mJ 11,32 I I * JQi I I. ''^'^J 11,42 _ [-''^wj 11,42 1 /^rj\ 

"^ IQs \[^rf]ll,22 [^"]ll,22 / "^ fQi V[^rf]ll,22 ['^«]ll,2; 



T^ /Qi A^Jai , ['^^21,32 \yu].2l ['^dll,; 

Vub - CQj - 



I * JQl I [^uUl I [-'QJ21,42 _ [-'mJ21 L-'aJii,42 \ /goX 



'fQsWuL [ydL.22 [YuL[Y,L^2 

Iq. [[y^ ^ [>^J21,42 _ [Yu]2r [YdU 

.[■'"Jii [^iiJii,22 [-'mJii [-'rfjii,; 

It is clear that if the 5D Yukawa matrix elements are all of order 1, then the observed 
hierarchies among the CKM elements can still be explained by hierarchies among the fi 
parameters. The explicit dependence on the 5D Yukawa couplings gives a more precise 
prediction for the mixing angles, which will be quite useful when looking for phenomenolog- 
ically viable points in parameter space. The results of such a scan are presented in the next 
subsection. 

B. Tree level Higgs FCNC couplings 

We now extend the one-family results presented in section |TT] to the case of four genera- 
tions. To leading order in Yukawa couplings, the SM fermion mass matrix is 

^d^P^-^^Dp^ t;4, (29) 

where "means a 4 x 4 matrix in flavor space. The misalignment in flavor space between the 
fermion mass matrix and the Yukawa coupling matrix is deflned as 

A"^ = m^ - 1)4 yi (30) 
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where yf is the 4D effective couphng matrix between the physical scalar Higgs and the 
quarks. 

Similarly to the one family case, the misalignment can be separated into two components, 
Af + A^, with (see [38]) 

M = I m'^liYi^y^m' {vlR'') , (31) 

'^ i'd -TQ 

and 

A^ = m^ (rh'^^k{cq) + k{-Cd)m'^^^ rh'^ R'^ (32) 

The crucial observation is that rh'^ and A'^ are generally not aligned in flavor space. 
Thus when we diagonalize the quark mass matrix with a bi-unitary transformation ih'^ — )■ 
Uq m'^Wd, the Yukawa couplings will not be diagonal. To be more specific, in models of 
flavor anarchy, we have 

iUQ„Wd)^,, r^ ^ for z<j. (33) 

jQj,dj 

Then the off-diagonal Yukawa coupling will be dominated by 

^.f = -iUlA'^WdJ.- ~ IfQy'fd^vlR", (34) 

where Y is the typical value of the dimensionless 5D Yukawa coupling. 

Since the Higgs couplings will now contain off-diagonal entries, we must choose a conve- 
nient parametrization for them. A common choice is to normalize the couplings with the 
fermion masses and write the Higgs Yukawa couplings as^ 



777, 777, _ 

^HFV = 4\/ -^Y^Hd^^d^ + h.c. + {d^u). (35) 



1. Analytical estimates of Higgs FCNC couplings in Flavor Anarchy 



In this section, following the same procedure as in ^38j, we estimate the off-diagonal 
couplings of Higgs boson to SM fermions and then we do a numerical scan over anarchical 
Yukawa couplings to support our estimates. 



We use Eqs. (|33l) and (|34l) to estimate the sizes of a"? . For example, we have 



< - lfQ.Y'UvlR'\l^^ ~ lxYhlR'\l^, (36) 



V msirid 3 y rud 



^ This is a particular realization of the Cheng-Sher Ansatz 
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where A ~ 0.22 is the Wolfenstein parameter, and we used fq^/fq^ ~ {Udi)i2 ~ (K 
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A. We can find the other a"' in similar fashion. We obtain: 
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(37) 
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The effect clearly decouples since it depends on R 
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(38) 



/ 



12 



Ml 



-. Taking the typical Yukawa size 

_ ''KK 

Y = 2 and 1/R' = 1500 GeV, and using the known SM masses evaluated at the KK scale, 
along with rrit' = 400 GeV and m^/ = 350 GeV, one can obtain the typical values of these 
couplings: 

/0.96 0.03 0.01 0.14 \ 

0.04 0.86 0.01 0.15 

0.13 0.19 0.57 0.45 

yO.Ol 0.007 0.003 0.57/ 






(39) 



%~ 



(40) 



uA 



( 0.96 0.16 0.15 0.09 \ 

0.008 0.86 0.04 0.02 

0.01 0.04 0.42 0.05 

\ 0.007 0.03 0.003 0.42/ 

Note that the results presented here are just estimates for the size of a"'", which come without 
sign or phases. However, we observe that for the third and fourth generation quarks, the 
corrections to the diagonal Yukawa couplings are always negative (suppressions) if Y\ = Y2 
and are larger than the previous estimates. This point was argued in [3H] and we address it 
again the next subsection for completeness. 

An interesting feature of these matrices is the asymmetry of af- in the hiVji and h'jJjR 
entries, asymmetry not shared by the up-quark matrix a^-. These would produce an asym- 
metry in the decays, as well as in the shift of the the vertex functions g\, g\ for Z -^ bb. 
This asymmetry will be typical to the (34 — 43) entries and thus non-universal. We expect 
the same feature in the charged lepton mass matrix. 
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2. Numerical results for Higgs FCNC couplings 

In order to obtain a better prediction of the typical size of the off-diagonal Yukawa 
couplings, and to compare with the previous estimates we perform a scan in parameter 



space. The results should be in general consistent with the rough estimates of Eqs. (39) and 



(40). Some differences observed can nevertheless be explained, (see also [3H]) so that one 
can still be confident in the generic size of the flavor violating couplings predicted in the 
flavor anarchy paradigm in RS type scenarios with four generations. 
We proceed as follows: 

• We fix mt' = 400 GeV and rrih' = 350 GeV as well as SM quark masses at the KK 
scale, taken to be mt = 140 GeV, m^ = 2.2 GeV, nic = 0.55 GeV, m^ = 5 x 10"^ GeV, 
m„ = 1.5 X 10-3 GeV, m^ = 3.0 x lO^^ GeV. We take the KK scale as R''^ = 1500 
GeV. 

• Then we generate random complex entries for Y^ and Yd, such that \Yi\ G [0.3,3.5]. 
We also generate random fg^ such that /g^ ~ C^(l)- 

• We then obtain /q, from iKfel/lKsl/lKbl, fg^ from iK^I/lKsl and fg, from |Ks| 



see Eqs. (26), (27) and (28)) 



We then obtain the right-handed down quark entries /^^ from mh'- 

Similarly for the up right-handed matrix entries, we obtain /„^, fu^, fdi, fd2 and fd^ 
from TTiu, rric, rrid, rng and mi,. We also obtain fu^^ and fu^ from mt and mf. 

Finally we check that the generated Yu and Yd along with the obtained Fg, Fu and 
Fd do indeed produce the observed masses and mixings of the SM. If so we keep the 
point in parameter space and continue until we obtain 1000 points which satisfy all 
constraints. 



For each acceptable point, we use Eqs. (31) and (32) to compute the fiavor violating 



Higgs Yukawa couplings, parametrized by the aj,'s as defined in Eq. (35) 



We present the results of the scan as follows: we give the 25% quantile and the 75% 
quantile of the obtained couplings. This means that 50% of our acceptable points contain 
a coupling in between the quoted values. Also it means that 25% of the generated points 
predict higher values than the range quoted, while 25% of the points predict lower values 
than the range quoted. 
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We find the following ranges for af-, a"- matrix couplings 

/ 0.919 -0.987 0.025-0.081 0.011-0.044 0.130 - 0.532 \ 

0.049-0.148 0.827-0.934 0.0.017-0.059 0.249-0.934 

0.140-0.470 0.142-0.446 0.620-0.819 0.873-2.508 

0.018-0.061 0.017-0.058 0.008-0.120 0.375-0.643 






\ 



(41) 



%~ 



/ 0.927-1.000 0.089-0.364 0.091-0.410 0.139- 0.612 \ 

0.015 - 0.052 0.816 - 0.949 0.065 - 0.197 0.092 - 0.300 

0.019-0.068 0.071-0.236 0.545-0.772 0.127-0.343 

0.0167-0.062 0.060-0.191 0.064-0.168 0.403-0.651 



to be compared with the rough estimates Eqs. (39) and (40). 



(42) 



3. Cumulative effect on diagonal Yukawa couplings when Yi = Y2 



We observe that the rough estimates are slightly smaller than the results of the scan, 
specially for the third and fourth generation couplings. This was already pointed out in [3H] 
for the three generation case. The argument given is that due to the presence of a fourth 
generation some of the coefficients will be different and typically the cumulative effect will 
be larger. 

We assume that Yi = Y'l' and consider for example the element (33) of the Yukawa 
coupling in the up quark sector, i.e. 



O'tt 



1 



2/2'^ 

3mt 

2i?'^ 

3mt 






33 



K''),AWI^WA (mf^) 



F2 



' J3 



u} 



3i 



Ju p2 



-Uc 



(mr)33. (43) 



i3 



First let's look at the contribution to au when the j index is equal to 3 (i.e. in the middle 
mass matrix m'^"'^ is rrtt). In this case, there will be 16 terms in phase, each proportional to 
and it is important to realize that every one of them will be real and negative. 



2i?'V2l.2 



there will be 2 terms 



2/?'2y2t,2 



but 



because {Wl^Wu)z:i > 0. When j = 2 {mf^a = m^, ...... .,_ ^. ^ _._. - 

every one of them will have generically a random complex phase (the 14 remaining terms 



^ This is an important choice, and without it no extra enhancements should appear. Nevertheless this 
choice is natural if the Higgs boson is to be considered as a highly localized 5D scalar field, and then 5D 
Lorentz invariance imposes Y\ =Yi. 
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are much smaller). For j = 1 (m^*°^ = mu) there is only one term ~ g— -^ contributing, 

with the rest 15 terms being again suppressed. So, summing, the dominant contribution to 
att will consist of 19 terms, 16 of which are negative and the rest 3 have random complex 
phases. Generically each of these terms are of the same size ~ "^R y v ^^ from a statistical 
argument, au — 1 should receive a negative contribution ~ — 16 ( ^^ J' ^ j . This cumulative 
effect is confirmed by the numerical scan. 

One can perform the same analysis for the rest of elements of the Yukawa matrix, in- 
cluding the off diagonal ones, and realize that typically there are a number of aligned terms 
in each case which enhances the naive estimate by an 0{1) factor (which can be estimated 
also). This fact gives us confidence that both our scan and our estimates are consistent and 
that our numerical results predict correctly in this scenario the generic size of the flavor 
violating couplings in the Higgs sector. 



4- Higgs FCNC couplings in the lepton sector 

We proceed in a similar fashion to evaluate Higgs flavor violation in the lepton sector. 
The difficulty with the lepton sector is that mixing matrices are not well-established here. 
The neutrinos can be either Dirac or Majorana, the charged lepton mixing matrix (PMNS) 
is not as well established as the CKM matrix, and there are several mechanisms to explain 
the large mixing angles and light masses for the neutrinos (see for example |l6l H?]). For all 
cases, the Lagrangian can then be parametrized as: 




mlm[ 



Chfv = a\j\l -^HUe^ + h.c. (44) 

Following [381 WJ\ , we analyze two types of scenarios. Depending on the neutrino model, the 
left-handed charged lepton profiles can be either hierarchical and UV localized, or similar 
and UV localized. The profiles of the right-handed charged leptons are always hierarchical 
and localized near the UV brane. We outline both cases below. 

• (A) In the case where the left-handed and right-handed profiles are hierarchical, they 
satisfy the following relations: 

fin-TF^, {OlJ'^-'-^, ^<J. (45) 

where fi^e are profiles of the left-handed and right-handed fields and {Oi^eY'^ is the 
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intergenerational mixing. Then the a^ become: 



<,-lY\vlR'').m:. (46) 



.. 3- ^^- .y^^ 



This a], are maximal when — ^ r-u -^ r^ .1 — i^ i.e., when the hierarchy of charged 
lepton masses gets equal contributions from the left-handed and right-handed fields. 



• (B) If right-handed profiles are hierarchical and left-handed profiles are similar, fl ~ 
fl^fh ^^^ profiles satisfy the following relations: 

flfe-^, §~0(1), |~4' ^<J^ (47) 

Yv4 fl fi m'. 

and the the parameter a\j becomes: 

4,-Iy\vIR'\1^. (48) 

These flavor violating Higgs Yukawa couplings to leptons can also lead to interesting 
collider signals for the decays of the fourth generation leptons, as discussed in the next 
section. 

C. Tree Level Z^ flavor violating couplings 

FCNC couplings of the Z° boson have been studied before in the context of warped 
scenarios with 3 generations [H]. These couplings arise basically from two sources. First, 
the bulk profiles of the lowest-lying massive gauge bosons (the SM Z^ and W^) are not fiat, 
yielding non-trivial and non-universal overlap integrals with the fermion profiles. Second, 
even if the Z^ and W^ profiles were fiat, there would still be a non-universal correction to 
these couplings due to misalignments in the fermion kinetic terms. In fact the correction 



has the exact same origin as the misalignment A2 in the Higgs sector shown in Eq. (32). 

For light quarks, the first source of misalignment dominates due to Yukawa suppression 
of the fermion kinetic term misalignments. But for heavier quarks, and specially fourth 
generation quarks, this last source of flavor should dominate and this is the one we consider 
in the following. 

We can write the couplings of fermions with Z^ as: 



£; 



gi Sij + {^6g^j d\fd'^+ qr 6ij + (^6, 



'9r 



d^/4 + {d^u), (49) 
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where ql = -p, — (Ta — Qsm.Ow'^) and qr = — QsinOw^ are the usual diagonal SM 

cos 6w cos Ow 

couplings with g the SU{2)l coupling constant, and Q and T3 the charge and the isospin of 

the quark in question. The corrections coming from the kinetic term misalignment are, for 

the down quarks, 

'^^ COS dw " 

^kin ^ _y_^ m'^K^m'^^ i?'2. (51) 

^^ cos 9w 

where m*^ is the fermion mass matrix before diagonalization, B!~ is the KK scale and K 



is a diagonal matrix whose entries K[c) were defined in Eq. (14). Upon diagonalization of 
the fermion mass matrix in order to go to the physical basis, these corrections will not be 
diagonal and will produce flavor violating coupling for the Z^ boson. The same mechanism 
applies in the up-sector. 

Once in the physical basis, we can parametrize the off-diagonal quark couplings in the 
Lagrangian by ( a^' j and ( a^' ) , with 



c 



ZFV 



COS 6 



w 



(ai) ^^ dta di - (ai) ^^ 4^ 4 +{d^u). (52) 



The Z° FCNC couplings ( O/^' ) , ( ct^' ) can then be obtained from the same scan used 
to obtain numerical values for the Higgs FCNC couplings. For example, for the (43) entries 
in the up and down sector, we find typical ranges 



al),3 


= 0.00350 - 


-0.0176, 


(O43 


= 0.0274 - 


- 0.0952, 


(53) 


4)43 


= 0.00356 - 


-0.0161, 


(4)43 


= 0.0209 - 


- 0.0830. 


(54) 



To obtain these values we followed the same procedure explained previously in the subsection 
"Numerical results for Higgs FCNC couplings". 

IV. PHENOMENOLOGY 

A. Bounds on Higgs-mediated FCNC couplings 

The off-diagonal Higgs Yukawa couplings induce FCNC, which affect many low energy 
observables and also give possible signatures at colliders. In this section, we discuss first 
bounds on Higgs flavor violation coming from tree-level processes AF = 2, such as K — K, 
B — B, D — D mixing. We then study the effects on loop processes, such as b and t flavor- 
changing decays, as well as on Z — ;■ bb, t^t^ . The radiative processes are enhanced due to 
heavy quarks in the loop, and strong off-diagonal Yukawa couphngs. 
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1. Tree-level processes 

The AF = 2 process can be described by the general Hamiltonian [251 HH] 

5 3 



a=l a=l 



with 

rililj _ ^a „a -13 B ^QiQj _ ^ J -P a 

V4 — IjRliLljL'iiR^ V5 ~ IjRliL^jL^iR^ 

where a, /3 are color indices. The operators Qa are obtained from Qa by exchange L -^ R. 
For K — K , Bd — Bd, Bg — Bg, D — D mixing, qiqj = sd, bd, bs and uc respectively. 

Exchange of the flavor-violating Higgs bosons gives rise to new contribution to C2, C2 and 
C4 operators [49j. These contributions have been included in [38], and the basic bounds on 
the coefficients are not altered. We present them here, for completeness, in a more general 
fashion, with no relation to the possible numerical values of the entries in the Higgs Yukawa 
mass matrix. We use the model-independent bounds on BSM contributions as in [25], and 
present coupled constraints on the Higgs flavor violating Yukawa couplings parametrized by 
the Gij couplings and the Higgs mass m^. 

• K^ — K^ mixing 

The coefficients C2, C2 and C4 will set limits on the real and imaginary of the Yukawa 
couplings afg, afi; ^^^ their product. Specifically, for the values of parameters used 
in the previous sections, we obtain, from AMk, respectively: 

KOI (^»^^)< 0,62. KOI (^«^i^) < 0.62. (57) 



mh 



■) 



The bounds obtained from ex are very stringent, and restrict the phases of the off- 
diagonal Higgs Yukawa couplings: 

, , ^ ,. /400 GeV\^ , ,,2 , , ^ ,. /400 GeV\^ , .,2 

Imiai^r [-^;;;^) ^ (4-6 x IQ-^) , lm{ai,Y [-^;;^) < (4-6 x IQ-^) 

ImiaUi,) (^^^^^X < (2.2 x lO'^^^ ^^g^ 
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jjo _ jjo mixing 

The D^ — Z)° mixing constrains the (12, 21) off-diagonal entries in the up-quark; ffavor 
changing mixings. 

,, „ ,, /400 GeV\ „ ,, „ ,, /400GeV\ 

400 GeVV 
rrih 



(«i2«2i)l(— I ) <(0.47r. (59) 



• B^ — B^ mixing 



The mass mixing in the 5° — B^ is fairly constrained, resulting in bounds on the 
(13, 31) entries in the down-quark flavor changing mixings. 

400 GeV\ , ,, ^ ,, /400GeV\ 
13; I \ — < 0.54, \{at,)\ — < 0.54, 



rrih J \ TUh 

«3«3i)l ( ^^^^^:^^ ) <(0.35)^ (60) 



Bg — B^ mixing 

The mass mixing in the B^ — B^ is less restricted than in the B^ sector, resulting in 
bounds on the (23, 32) entries in the down-quark flavor changing mixings. At flrst, 
these bounds may not appear useful; however, one must note that the matrix entries 
ttij are not otherwise constrained {e.g., by unitarity). 

,, . ,, /400GeV\ ,, . ,, /400GeV\ 

, ,,,/400GeVV^,^^^,2 



IK3«32)I(^ ^^ ) <{OMy. (61) 

With the exception of ex, these bounds are not too restrictive over the estimated size of 
the flavor violating couplings of the Higgs as our numerical evaluation show, even for lighter 
ruh ~ 200 GeV. 

In what follows, we compare the tree-level bounds with precision bounds coming from 
loop-generated processes including a heavy fermion in the loop. 

2. One-loop processes 

We evaluate flavor- violating radiative type processes of the form qi — )■ qj'-f, and /» — )■ Ij'j 
as well as Z — 7> 66 and Z — ?> t^t^. Though occurring at one-loop level, these processes 
are tightly constrained experimentally. For a recent calculation of these warped penguin 

19 





FIG. 3: Generic loop diagrams enhanced by FCNC couplings between Higgs boson and 4th gen- 
eration fermions. Here F stand for a 4th generation quark (or lepton), while fi,fj are 2nd or 3rd 
generation quarks (or leptons). The left-hand side graph is the vertex diagram, while the other 
two are self-energy diagrams. 

diagrams due to radiative exchanges of heavy KK states see [50]. In our scenario each 
process receives additionally non-universal contributions from the fourth generation quarks 
or leptons and Higgs bosons running in the loop. 

The contribution is enhanced for couplings with the third generation, as the FCNC cou- 
plings are larger. The basic process is illustrated in Fig. 3, where F represent fourth 
generation quarks or leptons, /«, fj, second or third generation quarks or leptons, and h is 
the Higgs boson . For instance, for b — ?■ s'j, F = b' , fi = b and fj = s quarks, while for 
Z — )■ T~^T~, F = t', and fi = r+, fj = r~. We analyze each process in detail. 

• 6 — 7- S7 induced by Higgs FCNC couplings. 
The decay rate of 6 — )■ 57 is 



T{b -^ 57) 



IGnmr 



3 V "^6 + mf — 2m^m2. 



(62) 



where the most dominant term in the matrix element A^^ is 



{M') 






[mt + mt- 2mlml)Cl [pl Pi {P, + P^f, ml„ml ml 



(63) 

and where Co is a three point integral as defined in Looptools [5T] (see Appendix A 
for a more detailed calculation). 



Using the experimental value of the branching ratio of i? — ?■ Xs'~f 
Br{B -^ X,7) = (3.55 ± 0.24 ± 0.09) x 10"^ 



(64) 



we can put a bound on ajj's such that 1042034! < 1-3. This is a very conservative 
bound. If we require the branching ratio to be the sum of the SM and the new physics 
contribution, and use the NLO result Bt{B — )• Xs''y)E-y>i.6 Gev = (3.60 ± 0.30) x 10~^ 
[52] , we obtain |a42af4| < 0.45. These values start to be quite restrictive, as compared 
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to the expected size predicted by our scenario |a42af4| — 0.85 (obtained from our 
numerical scan). 

r — 7- /i7, r — )■ 67, yU — )■ 67 induced by Higgs FCNC couplings 

The same operators will contribute to lepton FCNC decays. The experimental limits 
on these processes are |21] 

Br{T -^ fi-f) < 4.4 X 10"^ 
Br{T -> 67) < 3.3 X 10"^ 
Br{fi -> 67) < 1.2 X 10"^\ (65) 

The Higgs mediated diagrams with a heavy r' in the loop will yield limits on the a[ ■ 
parameters. Specifically, we get 

l44«42l <0.11, |444i|<1.45, |444i| < 0.002. (66) 

We also calculated the a\j values by using the two different scenarios. In scenario (A) 
where both the left-handed and right-handed profiles are hierarchical, we have 

kL'^Ll = l44'^4il = l44'^4il — 0.0065. (67) 

However, in scenario (B) where right-handed profiles are hierarchical and left-handed 
profiles are not, we get 

144421-0.0016, i444il -0.00011, i444il- 0.00045. (68) 

Using the a^ values in scenario (A) and F = 3 we calculated the branching ratios as 
Br(r -^ jj-f) = 1.4 x 10"^°, Br(r -^ 67) = 6.7 x lO^^^ and Br(/i -^ 67) = 6.2 x 10"^^ 

For scenario (B) (keeping F = 3) we have Br(r — ;■ fi'y) = 7.8 x 10^^^, Br(r — ^ 67) = 
1.9 X 10~^^ and Br(/i — )■ 67) = 2.9 x 10^^^. The predicted size of fiavor ciolating 
T decays lies just below experimental bounds, but the branching ratio for /i — )■ 67 
is above the experimental bounds in scenario (A), and therefore sets some bounds 
or pressure on our scenario. More stringent limits can be set when (expected) new 
experimental results become available. 

t — )• 67 induced by Higgs FCNC couplings 

Using the formalism from 6 — )■ 57 we can estimate the branching ratio for t — )■ 67. We 
obtain 

Br{t -> 67) = 1.55 X 10'^ [I4244P + |a43«24r + 0.253fJ (al^^al^al^a^^) 1 . (69) 
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which for our values of the scanned Higgs couphngs becomes Br(t — )■ cy) = 1.33 x 10 ^^, 
too small to be detected anytime soon, and comparable to the SM estimate Br(t — )■ 
C7) =4.5 X 10-13 |53]. 

• Z ^ bb decay and Z — )■ t^t^ 

For completeness we also computed the loop corrections to Z — )■ 66 decay and Z — )■ 
T^T^ . The b' and r' running in these loops make these diagrams larger than the 
corresponding case with three generations but are still too small to place any useful 
bound on the Higgs FCNC couplings. (See Appendix A for details.) 

3. Higgs production and decay 

The Higgs emerging in RS with 4 generations is in fact quite similar to the SM Higgs 
with 4 generations (SM4). The tree level couplings are still proportional to the masses of 
the particles it couples to. One of the main differences between four generations and three 
generations, from the Higgs perspective, is the new radiative contributions to the coupling of 
Higgs to photons and gluons. This last coupling is typically enhanced by a factor of ~ 0{3) 
(due to three heavy quarks running in the loops instead of only the top quark), and since 
the Higgs is mainly produced through gluon fusion at hadron colliders, one expects roughly 
an enhancement in production cross section of ~ C>{9). Of course this enhancement must 
be carefully calculated as it is still sensitive to the relative mass between the Higgs and the 
heavy quarks. In any case the production cross section of this Higgs with four generations 
will allow the appearance of many more Higgs bosons than predicted by the minimal SM. 
Therefore the SM Higgs bounds from Tevatron now become quite stringent, and even early 
LHC data allows exclusions in the parameter space [Ml [55] . In particular it seems that a 
Higgs mass smaller than 200 GeV is already excluded by hadron collider bounds (assuming 
that no new decay channels exist for the Higgs). We will take 200 GeV as a lower bound for 
our Higgs scalar and study the possible decay channels that such a heavy Higgs could have. 
The bands represent 50% likelihood for the branching ratio, as given in our numerical scan. 
(That is, 25% of all the parameter points from the numerical scan lie below and 25% lie 
above the shown interval.) The results are shown in Figure 111 where the branching fraction 
for each channel is presented. Not surprisingly the dominant decay modes for such a heavy 
Higgs {rrih > 200 GeV) are the usual decay channels, namely h — )■ ly^iy^ and h — t- Z^Z'^ 
where both W pairs and Z^ pairs are on-shell. These are the same dominant channels as 
in the SM; of course once above threshold the Higgs should also decay into pairs of heavy 
fermions. The typical expectation for models with four generations is that Higgs decays 
into ti, t'i', b'b', r' r'^ (fourth generation charged lepton pair) or z/^z/^ (fourth generation 
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FIG. 4: Decay branching fractions of the Higgs scalar in a warped scenario with four generations of 
fermions. The bands represent 50% hkehhood for the branching ratio, according to our numerical 
scan, as explained in the text. The gray region below 200 GeV is excluded by both Tevatron and 
LHC. The flavor anarchy setup (masses and mixings explained through fermion localization, with 
random 5D Yukawa couplings) predicts generic FV couplings of the Higgs, leading to a few new 
interesting decay channels such as h ^ bb' and h — )• tt' . The masses chosen for this plot are 
mi,' = 350 GeV, rrit' = 400 GeV, m^/ = 160 GeV and rriN^ = 250 GeV (iV4 = K), and the KK 
scale is {R')-^ = 1500 GeV. 

neutrino pair) will all have branchings similar to the branching of /i — )■ ti, given that the 
masses of these fermions should typically be in the hundreds of GeV (except maybe the u'^). 
That yields branching fractions at the 10% level, and this is confirmed in Figure |4| 

The new and very interesting result is the prediction of sizable branching fractions for 
exotic decays of the Higgs into fermion pairs of different flavor. In particular we observe 
that h — ;■ tt', h — > bb' and h — )• tt' are among the most important new flavor violating 
channels, a fact not surprising since for heavier fermions one expects larger couplings to the 
Higgs. An interesting remark for these new channels is that the threshold mass at which 
they become kinematically allowed is basically set by the mass of the heaviest fermion. This 
means that while some or most of the flavor diagonal decays into fermions might be closed, 
there are good chances of an open channel such as /i — )■ tt' or /i — )■ bb'. For the chosen 
parameters (KK scale of 1/R' = 1500 GeV and typical 5D Yukawa couplings of 0{2)) we 
obtain generic flavor violating Higgs couplings which place the branching ratios of these 
exotic decay modes on the order of 10~^. Note that since the flavor violating couplings scale 
as {YR'Y, the branching ratios should in turn scale as {YR')^, showing great sensitivity to 
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both the 5D Yukawa couphngs and the KK scale. 

The production cross section at the LHC of a heavy Higgs of 200 — 400 GeV, in a 
scenario with fourth generation quarks is expected to be about 50 — 70 pb [24J. Since 
the new exotic decays have branching ratios at the percent level, one expects the cross 
section of these modes to be somewhere near 500 fb. This means that with 1 or 2 fb~^ of 
integrated luminosity at the LHC (early stages) one could have at least a few hundred of 
these events. Of course given the large production cross section, there would be no problem 
in quickly discovering the Higgs via the four lepton mode {h — t- Z^Z^ — )■ 4/) or maybe 
through {h — > li^^l^^). With the Higgs mass properly set, a complementary search for 
some of the new exotic channels should be much easier. 

Of particular interest is the mode h — )■ tt' since it may actually compete as the main 
production mechanism for the fourth generation charged lepton. If rrih < 2771.^', the decay 
into pairs of r' is forbidden and so the other possible production for heavy leptons is through 
s-channel processes involving electroweak bosons [56] and their KK partners [32]. The typical 
cross section for r' — u'^ production via s-channel W is 10 — 100 fb [56], which means that 
the flavor violating production through s-channel on-shell Higgs of t^t'^ can be a few times 
larger than this. The subsequent decay of the r'^ — )■ u'^W^, and then of u'^ — )■ Wl should 
give a signal oi pp -^ h -^ t'^t'^ — )■ r'^W^Wl, where all particles are produced and decayed 
on-shell. The signs of the second W and the charged lepton / is not fixed and depends on 
the nature of u'^. One would look for same sign dilepton events coming from leptonic decays 
of the first W along with the last lepton of the chain. This type of signature is quite clean 
thanks to the minimal background and would in principle allow for easy confirmation of the 
signal, which could become the discovery signal for the r' along with the confirmation of 
Higgs fiavor violating couplings. 

Another interesting decay mode, if kinematically allowed is /i — ?■ bb', where the b' would 
subsequently decay as 6' — t- g P^ or 6' — > bZ^. In the first possibility, q stands for t if 
kinematically allowed, and for c or u. The partial width of these channels depend on the 
size of the CKM4 angles Vtb', Vd,' and Vub' which are typically constrained to be small p6]. A 
channel which could compete is 6' — t- 6Z°, since in the RS scenario under study these fiavor 
violating couplings appear at tree-level, in a similar fashion as in the Higgs sector [5l HI] . 
Thus depending on the decay branching ratios of the b' heavy quark (see next section) the 
events could he pp -^ h -^ bb' — )■ bW^t — )■ bbW^W^ or pp -^ h -^ bb' — )■ bW^ j or 
pp ^ h ^- bb' ^ bbZ^ . A careful study of these signals and their background is beyond the 
scope of this work, but we should mention that a clear prediction of our scenario is that 



the h — b — b' coupling is highly asymmetric (see Eq. (37)) with a definite preference for 
h — )■ b'^bi decay over the h — )■ b'lpR. Thus one should also look for the angular correlations 
in the signals in order to search for this asymmetric property of the couplings (see refs. [5] 
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for studies along these lines). 



4- Heavy fermion decays 



Heavy quark decays 



If the Higgs masses are lighter than the masses of the fourth generation fermions, channels 
in which the heavy fermions decay to the Higgs boson and a fermion from one of the lighter 
families are open. Pair production of heavy quark flavors is expected to have a cross section 
of ~ 4 - 4.5 pb for a mass of 500 GeV^ at the LHC with ^/s = lA TeV |58], thus should be 
within reach, and their properties would then become apparent. As the FCNC couplings of 
the Higgs to the fermions are proportional to fermion masses, the dominant decays would 
be to the third generation fermions. The flavor violating couplings of Higgs will lead to 
tree-level decays t' — )■ th and b' — > bh in the kinematically allowed regions mt> > ruh + rrit 
and nib' > ^^h + i^b- The decay rates for these processes are calculated as 

1 



V{Qj -^ q,h) 



167rm^ 



mf + m^, + mi — 2mfm'^ — 2mfml — 2m^ml 



X 
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(70) 



These decays can have significant decay width, and branching ratios. By comparison, the 
other dominant two body decay modes are t' — )■ bW and b' — )■ tW, given by 



r(Q,- ^ QiW) 
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(71) 



by substituting the corresponding quarks in the two body decays. The flavor-changing 
couplings of quarks to the Z° boson allow FCNC quark decays via the process Q — )■ gZ°. 
The branching ratio is [Hj 



r(g, ^ g,zO) 



aTl 



8M| cos2 Owm) 
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^ The cross sections are estimated based on QCD effects oniy, and are based on approximate fcnowledge of 
PDF, thus should be only seen as indicative. 
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with T3 the third quark isospin component and with the flavor-changing couphngs a^' and 
a^ as deflned in given as in Eq. (p2J). We deflne the total width to be the sum of the 
dominant two body-decays 

T{Qj -^ 2X) = TiQj -^ QiW) + r(g, ^ Qih) + TiQj -^ qiZ^). (73) 

Although the decays Qj -^ QiW, Qj — )■ qiZ and Qj — )■ qih, 2 = 1,2 should be subdominant 
due to CKM and Yukawa suppression, for completeness we include them in our numerical 
calculations and plots. 

In Figure IS] we illustrate the branching ratios for the t' quark for nih = 200 GeV (still 
allowed by present bounds on the Higgs in the presence of four generations [HH]) for two 
choices of KK mass scales, R'^^ = 1.5 TeV and R'^^ = 3 TeV, and for two choices of 
the CKM4 mixing involved here, i.e Vfb = 0.1 and Vfb = 0.3. The latter will affect the 
tree-level decay t' -^ b W, typically assumed to be the dominant decay for the usual choice 
rrit' — nif,' < 50 GeV. The characteristic bands appearing in these flgures are due to the fact 
that the flavor violating couplings for both Higgs and Z^ are obtained from numerical scans, 
performed for different values of the heavy quark masses. To visualize the generic region in 
parameter space that the branchings should cover, we show the interval of couplings inside 
which 30% of all the generated points lie, such that 35% lie below that interval and 35% lie 
above. This procedure will deflne "bands" in the flgures which should be understood as the 
generic region predicted by flavor anarchy, containing 30% of the random points (with 35% 
of the points lying above the band and 35% lying below). 

We compare the dominant branching ratios for tree level decays: t' — )■ 6 W, t' ^ th 
and t' —7- tZ^, and also the subdominant decays t' — )■ q'W, t' ^ q Z and t' -^ qh with 
q' = d,s and q = c,u. Compared to these tree-level decays, the branching of loop-induced 
processes such as Br(t' — )• ^7) ~ (9(10~^) are much smaller. In all three plots we observe 
the importance of the decay rate t' -^ th, which will generically dominate for a KK scale 
of 1.5 TeV and a moderate CKM4 entry Vfb = 0.1. By increasing the KK scale or Vt'b, the 
branching oi t' -^ bW is enhanced, but we observe that the decay into Higgs and bottom 
remains well above the 20% branching in the worst case considered. In general one can see 
that the flavor violating decays of the t' are signiflcant for all parameter values chosen, and, 
as long as they are kinematically allowed, they clearly dominate over the intuitive channel 
t' — )■ bW. Of course, the effect depends on {R' Y'^Y and will decouple for a large enough 
increase of the KK scale R'^ . Therefore, which decay is dominant depends sensitively on 
the KK scale R!~^ and also on the CKM mixing Vt'b- In particular, for R!~^ = 1.5 TeV 
and Vt'b = 0.1 (a value favored in the flts of [26j), the branching ratio for t' —^ th seems 
to be predicted to be dominant and about twice as large as the one for t' ^ bW over the 
allowed parameter space. While for R'~^ = 3 TeV and Vfb = 0.1, the branching ratio for 
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FIG. 5: Branching ratios for 2-body t' decays with CKM4 mixing angle Vt'b = 0.1 and KK scale 
B!-^{= Mkk) = 1.5 TeV (left panel), Vfb = 0.3, B!'^ = 1.5 TeV (middle panel) and Vt'b = 
0.1, E!-^ = 3 TeV (right panel). We take Vfs = Vfd = 0.01 and ruh = 200 GeV throughout. 
The bands represent 30% likelihood for the branching ratio, according to our numerical scan, as 
explained in the text. 

t' — 7- i /i is now predicted to be about two to three times smaller than that of t' — t- 6 W . For 
the intermediate choice, B!~^ = 1.5 TeV and Vfb = 0.3 the branching ratio for t' ^ bW 
overlaps with that for t' ^ th over a significant range of parameter space. 

In all three plots, the flavor violating decay t' — )■ tZ° is subdominant, yet non-negligible 
either, with possible branchings ranging from about 1% to 10%. This channel becomes 
specially interesting when the decay into Higgs is kinematically forbidden, namely for f 
masses below the threshold mt + rrih — 370 GeV, but the decay into top and Z is open. 

We also include the suppressed decays t' — )• qih, t' — )■ g, Z° and t' — )■ qjW, i,j = 1,2. 
The Z° decay width is sometimes too small and its branching ratio falls below 10^^, which 
is why it does not appear in the plot. We take a generic value for V^gj = 0.01 and include 
FCNC coefficients 04^(^4), (0^)4^(44) from our scan. 

Thus the decay t' ^ th, if kinematically allowed, is a promising channel for observing f 
pair production as well as a novel Higgs pair production channel, in the subsequent decays 
of the heavy quarks. 

It may even be possible to see simultaneously the two dominant decays^ if the branching 



One might also be able to observe the decays t' — > tZ^ even if clearly subdominant over the parameter 
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ratios happen to be of similar size, giving rise to interesting pair production processes and 
decays: 

• pp — )■ ft' — )■ tthh • pp -^ ft' — )■ tbhW 

• pp^ ff -^ bbWW 

all potentially accessible and thus providing an indirect confirmation (or at least a consis- 
tency check) of the warped extra dimensional model and its parameter space. In particular, 
the relative importance of these signals would provide valuable hints on the size of the KK 
scale as well as of the CKM4 angle Vfb- Note also that if the KK scale is such that R'~^ = 1.5 
TeV, the lightest KK particle in the minimal scenario would have a mass of (9(3 TeV) and 
may escape detection at the LHC, while the exotic flavor violating decays (caused by the 
presence of KK particles) of the fourth generation quarks would still be observable. 

We perform the same analysis for the decays of the b' quark as shown in Fig. |6} As before, 
we choose three parameter combinations for the KK scale and for the main CKM4 mixing 
angle involved in these decays, i.e R'~^ = 1.5 TeV and Vtb> = 0.1, then R'~^ = 1.5 TeV and 
Vtb' = 0.3, and finally R'~^ = 3 TeV and Vtb' = 0.1. The dependence of the branching ratios 
of FCNC decays of the b' quark is more or less similar to the corresponding ones for the f 
quark, with the decay b' ^ bh dominating over all others for R'~^ = 1.5 TeV and Vtb' =0.1, 
while for the two other parameter choices the decay b' ^ tW has the largest width for 
rrib' > 250 GeV (ahhough it overlaps with b' ^bh for Vtb' = 0.3, R''^ = 1.5 TeV). 

The flavor violating decays b' ^ bh, b' ^ b Z^ have a lower kinematic threshold than 
f ^ th and therefore can happen for b' masses just above the Higgs (or Z°) mass. But 
the W-mediated decays of the b' start at a larger mass threshold than in the previous CKM 
decays of the f, since charged current decays of b' will involve a top quark and a W, both 
heavy. This means that in the low b' mass region, the FCNC decays start dominating. Of 
course as the mixing angle Vtb' is increased, the relative importance of the charged current 
decay grows as expected. As before, we include the CKM4 and afj, {a'l)ij suppressed decays 
b' — !■ qi h, b' — )• qi Z^ and b' — )■ qj W, i,j = 1, 2, with a generic value for Vb'qj = 0.01 and 
including the FCNC couplings a'^^r^^), {a'D^i^a) from our scan. 

Again, the b' ^ hb decay will be very important in all the parameter points considered, 
being dominant for low KK scale and small CKM4 mixing angles, and then competing with 
the decay b' -^ tW when KK scale or Vtb' are increased. The decay b' —> b Z^ is suppressed 
relative to the other two, but still important, with branching ratios reaching 1% -6%. 

space. 
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FIG. 6: Branching ratios for 2-body b' decays with CKM4 mixing angle Vtb' =0.1 and KK scale 
R'-^{= Mkk) = 1.5 TeV (left panel), Vw = 0.3, B!'^ = 1.5 TeV (middle panel) and Vw = 
0.1, R'-^ = 3 TeV (right panel). We take Kfe' = Kfe' = 0.01 throughout as well as my, = 200 GeV. 
The bands represent 30% likelihood for the branching ratio, according to our numerical scan, as 
explained in the text. 

As before, we include the CKM and Yukawa suppressed decays h' — )■ q' W, b' — )■ qh and 
b' — 7- qZ, with q' = u,d and q = s,d. Again, FCNC decays of b' through Higgs or Z^ bosons 
would provide an indirect indication of the warped space scenario, even for large KK scales 
such as R'~^ = 3 TeV. From the plots one see that it may again be possible to observe at 
the same time the dominant decay modes of the b' quark (since these are produced in pairs). 

For a lighter b', below the threshold for b' — ?■ tW, i.e. m'j^ < 250 GeV one sees that the 
FCNC decays into Higgs and into Z^ might dominate over decays into W and light quarks 
(and hence might substantially alter the current experimental bounds on the b' mass where 
CKM decays are assumed). In that situation it may be possible to observe a mixture of 
events: 



pp — 7- b'b' — 7- bbhh 
pp -^ b'b' -^ bbZZ 
pp — )■ b'b' — )■ qWqW 



pp — )■ b'b' — )■ qWbh 
pp -)■ b'b' -)■ bZbh 
pp — )■ b'b' — )■ bZqW 



Of these, the events containing a Higgs would be the cleanest by far, since the Higgs 



29 



itself should decay into WW or ZZ giving rise to events with many gauge bosons. 

For a heavier b', it appears that two modes should dominate, namely the FCNC decays 
onto Higgs and the decays into a W and a top quark (due to our assumption of Vtb> being 
the largest of the CKM4 mixing angles involved). The possible mixed events could now be 

• pp ^ b'b' — )■ bbhh • pp ^ b'b' — )> tWbh 

• pp^ b'b' -^ tWtW 

All events would be easy to identify at the LHC and their relative importance would 
provide again valuable information on the model parameters of this scenario. 

• Heavy lepton decays 

Once the r' lepton is produced at a collider, its FCNC decay will proceed in the same manner 
as that of the b' quark. As the mass bounds on new r' leptons and u'^ neutrinos are close, it 
may be that the decay t' — )■ Wu'^ is kinematically forbidden, and the decay of r' to lighter 
neutrinos (r' — )■ Wui, i = 1,2,3) depends on the specific model of neutrino masses and 
mixing and may be suppressed. Thus the FCNC decays t' — )■ hr, and r' — )> tZ^ could be 
the most dominant decays. Since we are assuming that rrih + rrir < rrir', the production of 
t' should happen via s-channel W bosons and KK partners, and therefore would typically 
come with associated production of u'^ (if the mixing to lighter neutrinos is smaller). 

The subsequent FCNC decays of t' should be easily disentangled at the LHC as we would 
obtain several possible processes with many leptons, such as pp — ?> tVt- — )■ rhWl for the case 
of t' — 7> rh decays. The Higgs, being heavier than 200 GeV, should mainly decay into pairs 
of gauge bosons giving rise to final states of WWWlr or ZZWIt, i.e. three gauge bosons, 
one light lepton and a r, a clean enough signal at hadron machine. These might give rise to 
same-sign dilepton events, trilepton events, and pushing it, to 6 leptons plus r events, when 
every boson decays leptonically. 

In the case of r' — )> tZ^ decays, one would similarly obtain processes like pp — ?■ rV^ — )■ 
tZWI. Again one might observe same-sign dilepton events, trilepton events and when the 
all bosons decay leptonically one could obtain events with four leptons and a r. 

As in the previous section, a realistic analysis of these signals is beyond the scope of 
this work, however, it seems clear that it would not be hard to disentangle them, as the 
branching ratios are subdominant to t' — )• /ir, but nonetheless significant. 
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V. CONCLUSIONS AND OUTLOOK 

In this work we analyzed the effects of Higgs flavor-violating couplings in the framework 
of warped extra dimensions on a fourth generation of quarks and leptons. In this model, the 
Higgs Yukawa couplings are misaligned with the fermion mass matrices, and this effects is 
even more pronounced in a model with a sequential fourth fermion family, due to cumulative 
effects in flavor space. 

We presented both an analytical evaluation and a numerical estimate of the size of the 
Higgs FCNC couplings in models with flavor anarchy. The only requirement is that the three- 
generations quark masses and mixing angles should be reproduced in the present scheme, 
while the fourth generations masses and mixings are allowed to be free, limited only by 
VcKMi unitarity. We briefly discussed the possibilities for the lepton sector, which is unfor- 
tunately complicated by the lack of a well-defined model of neutrino masses and mixings; 
as well as revisited the FCNC couplings of the Z° boson with a fourth generation. 

After setting up the model and evaluating the Yukawa couplings, we analyzed the new 
effects on low energy FCNC observables. At tree level, the new off-diagonal couplings affect 
}{0 — ^°, D^ — D^ and B^^ — B^^ mixings. We use the data to set constraints on the 
Ojj, the most stringent bound coming from ex constraining the phases of the FCNC Yukawa 
couplings. The constraints are similar to the those obtained in the three-generations scenario 
[38] and the bounds imposed are not stringent, even if we expect the 3x3 Yukawa couplings 
to be reduced in the four-generation model. The Yukawa FCNC couplings contribute to loop- 
level processes such as 6 — )■ 57, t — )■ 07, r — )■ e, (/i)7 and /i — )■ 67. For the quark radiative 
decays, the effect is negligible compared to SM values and Wq diagrams. For leptons, 
depending on the size of the FCNC Higgs Yukawa couplings, the radiative decays might 
become more important and restrict the a' • beyond the expectation from the numerical 
scan, especially from the /i — )■ 67 decays, and even more as the bounds on lepton-flavor 
violation are expected to improve in the near future. 

As the present limits on the Higgs masses are pushed higher, especially for the case of 
four generations, the Higgs boson decay patterns can be substantially modified from the SM 
and even SM4 expectations. FCNC decay channels such as tt', bb' and even tt' open for 
rrih ^ 200 GeV, for present bounds on four-generation masses. Both h — t- tt' could prove 
to be fertile grounds for discovery of the fourth generation leptons, if the decay h — t- t't' 
is kinematically forbidden. Similarly, the decay h — )■ bb' could be an important channel for 
b' discovery if off-diagonal fourth generation mixing angles Vub', Vet' and Vtb' are small. The 
decays are important for the whole parameter space rriti > 400 GeV, rrih/ > 200 GeV and 
would provide a clear indication of the model. 

If the fourth generation quarks and leptons are heavier than the Higgs boson, their decay 
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into lighter quarks and Higgs bosons would be a promising channel for their discovery and 
identification. In particular, the branching ratios for t' — )■ th and h' — ?> hh compete with 
t' — 7> tZ^ and y — 7- hZ^ , dominate for most of the parameter space, and approach 1 for 
a significant range of Vt'b-, Vtb' and mti, miy parameter space. And the fourth generation 
lepton which can only decay through electroweak processes, may not be able to decay into 
Wv'^ or Wvr (depending on mass and mixing constraints in the leptonic sector), making 
t' ^ rh a, dominant decay mode, and competing with t' — )> tZ^. 

Thus, even if the KK scale is heavy, and KK particles cannot be seen at the LHC, residual 
effects due to Higgs FCNC could provide the most promising indirect signals for the warped 
space scenario. Our analysis shows that in a four-generation model, which is natural in this 
scenario, the results could be enhanced over the model with three generations and yield 
measurable signals at the LHC. 
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VII. APPENDIX A - LOOP CALCULATIONS 

We present in this appendix explicit results for some of the radiative corrections addressed 
in the main text. 
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where Bq and Bi stand for two-point coefficient functions with different arguments 
than Bq and Bi. The arguments of the scalar and tensor-coefficient functions appear- 
ing in the three-point integrals are ( Pf , P|, (Pi + P2)^, ml,, ml, m^l, ) . The two-point 

integral coefficient functions Bq and Pi have the arguments (m^,m^,m^, j while the 

arguments of Bq and Pi are (m^,m^,m^, j. Although P's depend on different argu- 
ments, their numerical values are almost the same as those of the P's 



The decay rate is 
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Z ^ bb decay 

The radiative corrections to Z ^ bb vertex are 
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The results are in good agreement with [60j in the limit mb — > and when the inter- 

fzbb and g^bb 



mediate particle is the b rather than the b' quark. g^,T and g^,T are the tree level Zbb 



couplings of the SM and they are given by 
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The arguments of the scalar and tensor-coefficient functions [6T] appearing in the 
three-point and in the two-point integrals are lP^,P2, (Pi + P2)'^,m,1,m,l,,m,l,] and 

ml, ml, ml 



,2 ^2 ^2 \ respectively. We note the following: 
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1. The largest contribution to g^{b) comes from the term 2 2 9zbb\^t'i\'^ ['^b'C'o] 

J-DTT Va 

4.65202 X 10"^ 



2. The largest contribution to g (b) is 



Y^^9zti\<\\-^ool 



[2Co 



-1.4136 X 10" 



3. In this calculation, even if some terms include phases, they contribute as the 
coefficient of either (Ci — C2), which is almost equal to zero, or B'^ which is neg- 
ligible compared to the dominant terms. Thus, the phases in the Higgs Yukawa 
couplings ttij do not affect the final result. 



Z ^ 



T ' T 



The Higgs-mediated loop contribution to the width r{Z — )■ l^l~) with a heavy 
t' in the loop proceeds as Z — > 66 and induces a non-universal correction to the 
T^T^ decay. However, the correction due to the FCNC in the loop is very small 
{^9zt+t-^ ^9zt+t- — C^(10"'')) for both proffies (A) and (B) in subsection IIIB4) and 
thus the change in width, when compared to r(r^r~)/r(e'''e~) = 1.0019 ±0.0032 |2^ 



it does not set any meaningful bound on the FCNC Higgs couplings in the leptonic 
sector. 

VIII. APPENDIX B - FERMION MASSES IN RS4 

First let's define our notation. If A is an n x n matrix, then [A] . . represents its {ij} ffist 
order minor, i.e. the determinant of the (ra — 1) x (ri — 1) submatrix obtained by removing 
row i and column j to A. We will also use the notation [A].. ^^ to represent the {ij,a(3} 
second order minor of A, i.e. the determinant of the (n — 2) x (n — 2) submatrix obtained 
by removing rows i and a, and columns j and (3 to the matrix A. 
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and 
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where we have used the property [AB] = [A][B]. 

We can therefore obtain the leading contributions to the quark masses 
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Again, we can always write 
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and to lowest order in ratios of /j's we can write 
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The leading contributions to the down quark masses are 
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Since fn-, ~ foA we must have that -^ ~ -^^ ~ 10 ^. 
Because of this, we can find also 
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